Skip to main content

Let’s Cook: An Augmented Reality System Towards Developing Cooking Skills for Children with Cognitive Impairments

  • Conference paper
  • First Online:
Smart Objects and Technologies for Social Good (GOODTECHS 2017)

Abstract

Although activities of daily living are often difficult for individuals with cognitive impairments, their autonomy and independence can be fostered through interactive technologies. The use of traditional computer interfaces has however proved to be difficult for these users, bringing to the surface the need for novel interaction methods. This paper proposes Let’s Cook, an innovative Augmented Reality game, designed to teach children with cognitive impairments how to prepare simple meals, following a playful approach. Let’s Cook supports multimodal interaction techniques utilizing tangible objects on a table-top surface, as well as multimedia output. Additionally, it can be personalized to accommodate the diverse needs of children with cognitive impairments by employing individual user profiling. The system is currently installed in the kitchen of the Rehabilitation Centre for Children with Disabilities in Heraklion, Crete where it was evaluated by the students.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The detailed evaluation questions and their statistical analysis will be reported elsewhere due to space limitations.

References

  1. Braddock, D., Rizzolo, M.C., Thompson, M., Bell, R.: Emerging technologies and cognitive disability. J. Spec. Educ. Technol. 19(4), 49–56 (2004)

    Article  Google Scholar 

  2. Scherer, M.J.: Assistive Technologies and Other Supports for People with Brain Impairment. Springer, New York (2011)

    Google Scholar 

  3. Salah, A.A., Schouten, B.A., Göbel, S., Arnrich, B.: Playful interactions and serious games. J. Ambient Intell. Smart Env. 6(3), 259–262 (2014)

    Google Scholar 

  4. Göbel, S., Hardy, S., Wendel, V., Mehm, F., Steinmetz, R.: Serious games for health: personalized exergames. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 1663–1666. ACM (2010)

    Google Scholar 

  5. Lindley, C.A., Sennersten, C.C.: Game play schemas: from player analysis to adaptive game mechanics. In: Proceedings of the 2006 International Conference on Game Research and Development, pp. 47–53. Murdoch University (2006)

    Google Scholar 

  6. Dunleavy, M., Dede, C., Mitchell, R.: Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 18(1), 7–22 (2009)

    Article  Google Scholar 

  7. Ntoa, S., Leonidis, A., Korozi, M., Papadaki, E., Adami, I., Margetis, G., Antona, M., Stephanidis, C.: Analysis and design of three multimodal interactive systems to support the everyday needs of children with cognitive impairments. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9177, pp. 637–648. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20684-4_61

    Chapter  Google Scholar 

  8. Mechling, L.C.: Assistive technology as a self-management tool for prompting students with intellectual disabilities to initiate and complete daily tasks: a literature review. Educ. Train. Dev. Disabil. 252–269 (2007)

    Google Scholar 

  9. Lopresti, E.F., Mihailidis, A., Kirsch, N.: Assistive technology for cognitive rehabilitation: state of the art. Neuropsychol. Rehabil. 14(1–2), 5–39 (2004)

    Article  Google Scholar 

  10. Lopresti, E.F., Bodine, C., Lewis, C.: Assistive technology for cognition [Understanding the Needs of Persons with Disabilities]. Eng. Med. Biol. Mag. IEEE 27(2), 29–39 (2008)

    Article  Google Scholar 

  11. Brandão, J., Cunha, P., Vasconcelos, J., Carvalho, V., Soares, F.: An augmented reality gamebook for children with autism spectrum disorders. In: The International Conference Focused on e-Learning in the WorNplace (2015)

    Google Scholar 

  12. Silva, G.F.M., Raposo, A., Suplino, M.: PAR: a collaborative game for multitouch tabletop to support social interaction of users with autism. Procedia Comput. Sci. 27, 84–93 (2014)

    Article  Google Scholar 

  13. Chang, Y.J., Kang, Y.S., Huang, P.C.: An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disabil. 34(10), 3049–3056 (2013)

    Article  Google Scholar 

  14. Mansor, E.I., De Angeli, A., De Bruijn, O.: Little fingers on the tabletop: a usability evaluation in the kindergarten. In: 2008 3rd IEEE International Workshop Horizontal Interactive Human Computer Systems, TABLETOP 2008, pp. 93–96. IEEE (2008)

    Google Scholar 

  15. Marco, J., Cerezo, E., Baldassarri, S., Mazzone, E., Read, J.C.: Hybrid games: designing tangible interfaces for very young children and children with special needs. In: Nijholt, A. (ed.) More Playful User Interfaces, pp. 17–48. Springer, Singapore (2015). https://doi.org/10.1007/978-981-287-546-4_2

    Google Scholar 

  16. Jang, H.B., Kim, J.W., Lee, C.W.: Augmented reality cooking system using tabletop display interface. In: International Symposium on Ubiquitous VR, p. 1 (2007)

    Google Scholar 

  17. Zidianakis, E., Antona, M., Paparoulis, G., Stephanidis, C.: An augmented interactive table supporting preschool children development through playing. Proc. AHFE Int. 2012, 21–25 (2012)

    Google Scholar 

  18. Poutouris, E., Korozi, M., Leonidis, A., Louloudakis, N., Stephanidis, C.: ConstrAct: an educator-oriented design studio for ambient educational games. In: Proceedings of the 9th Annual International Conference on Education and New Learning Technologies, pp. 8475–8484, EDULEARN 2017 Proceedings (2017)

    Google Scholar 

  19. Drever, E.: Using Semi-Structured Interviews in Small-Scale Research. A Teacher’s Guide (1995)

    Google Scholar 

  20. Lancioni, G.E., O’Reilly, M.F., Seedhouse, P., Furniss, F., Cunha, B.: Promoting independent task performance by persons with severe developmental disabilities through a new computer-aided system. Behav. Modif. 24(5), 700–718 (2000)

    Article  Google Scholar 

  21. Mechling, L.C., Gast, D.L., Seid, N.H.: Using a personal digital assistant to increase independent task completion by students with autism spectrum disorder. J. Autism Dev. Disord. 39(10), 1420–1434 (2009)

    Article  Google Scholar 

  22. Miyawaki, K., Sano, M., Yonemura, S., Matsuoka, M.: A cooking support system for people with higher brain dysfunction. In: Proceedings of the ACM Multimedia 2009 Workshop on Multimedia for Cooking and Eating Activities, pp. 47–52. ACM (2009)

    Google Scholar 

  23. Ju, W., Hurwitz, R., Judd, T., Lee, B.: CounterActive: an interactive cookbook for the kitchen counter. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, pp. 269–270. ACM (2001)

    Google Scholar 

Download references

Acknowledgments

This work is supported by the FORTH-ICS internal RTD Programme ‘Ambient Intelligence Environments’.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eleni Papadaki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Papadaki, E., Ntoa, S., Adami, I., Stephanidis, C. (2018). Let’s Cook: An Augmented Reality System Towards Developing Cooking Skills for Children with Cognitive Impairments. In: Guidi, B., Ricci, L., Calafate, C., Gaggi, O., Marquez-Barja, J. (eds) Smart Objects and Technologies for Social Good. GOODTECHS 2017. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 233. Springer, Cham. https://doi.org/10.1007/978-3-319-76111-4_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76111-4_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76110-7

  • Online ISBN: 978-3-319-76111-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics